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CLAIMS 

What is claimed is: 

1. A method for balancing transmission unit traffic over 
5 network links, comprising: 

a. disposing transmission units into flows; 

b. grouping flows into first flow lists, each of the first 
flow lists corresponding to a selected network link; 

c. determining a traffic metric representative of a traffic 
10 load on the selected network link; 

d. responsive to the traffic metric, regrouping flows into 
y second flow lists corresponding to the selected network link, the 
00 regrouping balancing the transmission unit traffic among the 
CI network links; and 

Pl5 e. transmitting the respective second flow list over the 

respective selected network link. 

5*1 2. The method of Claim 1, wherein each of the transmission 

O units comprise one of a packet, a frame, a cell, and a combination 

J42 0 thereof. 

3. The method of Claim 1, wherein each of the transmission 
units includes one of source information, destination information, 
and a combination thereof, and the disposing comprises 
25 characterizing each of the transmission units according to one of 
the source information, the destination information, and a 
combination thereof. 
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4. The method of Claim 1, wherein the transmission unit 
traffic is effected using a predetermined link-layer transmission 
protocol . 

5 5. The method of Claim 4, wherein the predetermined link- 

layer transmission protocol is one of a packet-based protocol, a 
cell-based protocol, a frame-based protocol, and a combination 
thereof . 

10 6. The method of Claim 5, wherein the predetermined link- 

layer transmission protocol is one of an IEEE STD . 802 protocol, an 
: Ji ATM protocol, an FDD I protocol, an X.2 5 protocol, an ISDN protocol, 

a CDPD protocol, and a Frame Relay protocol. 

il5 7. The method of Claim 4, wherein the predetermined link- 

O layer transmission protocol communicates the transmission unit 

L traffic over the network links in cooperation with a network-layer 

^ protocol . 

Q20 8. The method of Claim 4, wherein the predetermined link- 

r " layer transmission protocol communicates the transmission unit 

traffic over the network links in cooperation with a transport- 
layer protocol. 

25 9. The method of Claim 7, wherein the network-layer protocol 

cooperates with a transport -layer protocol to communicate the 
transmission unit traffic across the network links. 
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10. The method of Claim 7, wherein the network-layer protocol 
is one of a connectionless protocol and a connection-based 
protocol . 

5 11. The method of Claim 10, wherein the network-layer 

protocol is a connectionless protocol, and the connectionless 
protocol is an internet protocol (IP) . 

12. The method of Claim 10, wherein the network-layer 
10 protocol is one of an internet protocol (IP) , a Switched Multi- 
megabit Data Service protocol (SMDS) , a general packet radio 
service (GPRS), a Message Transfer Part Level 3 protocol (MTP3) , a 
W an internet packet exchange protocol (IPX), an X.25/X.75 protocol, 
Ci a connectionless network protocol (CLNP) , internet datagram 

§15 protocol (IDP) , a datagram delivery protocol (DDP) , a Xerox Network 
O Systems protocol (XNS) , and a combination thereof. 

\1 13. The method of Claim 9, wherein the transport -layer 

bi protocol is one of a connectionless protocol and a connection-based 

Q2 0 protocol. 

14. The 

protocol is a 
protocol is a 

25 

15. The method of Claim 13, wherein the transport -layer 
protocol is one of a transmission control protocol (TCP) , a user 
datagram protocol (UDP) , a NetBIOS protocol, an H.323 protocol, a 
GSM/CDMA protocol, a Stream Control Transmission Protocol ( SCTP) , 

3 0 and a combination thereof. 



method of Claim 13, wherein the transport-layer 
connection-based protocol, and the connection-based 
transmission control protocol (TCP) . 
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16. The method of Claim 9, wherein the network-layer protocol 
is a connectionless protocol and the connectionless protocol is an 
internet protocol (IP) , and wherein the transport -layer protocol is 
a connection-based protocol, and the connection-based protocol is 
a transmission control protocol (TCP) . 

17. The method of Claim 1, wherein the network links are 
network links having heterogeneous speed. 

18. The method of Claim 3, wherein the first flow lists are 
ordered flow lists. 

19. The method of Claim 18, wherein each of the ordered flow 
list comprises a linked list ordered by flow size. 

20. The method of Claim 19, wherein the ordered flow list is 
ordered by decreasing flow size. 

21. The method of Claim 1, wherein determining a Traffic 
Metric representative of a traffic load on the selected network 
link comprises: 

W,.<) = M — 



where 

T(f x ,t) is a Traffic Metric of Flow f x in selected 
link i, sampled at time t; 
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N Lt (f x ,t) is the number of transmission units of Flow 
f x in selected link 1, with a transmission unit size 
greater than or equal to a preselected size threshold, 
observed between time t - 1 and time t; 

jV 5 ,(f x ,t) is the number of transmission units of 

Flow f x in selected link i, with a transmission unit size 
less than a preselected size threshold; observed between 
sampling time t - 1 and time t; 

K ix is a predetermined link load factor; and 

A^is the inter-sampling time, measured as the 
interval between time t - 1 and time t, in selected link 
i . 

22. The method of Claim 21, wherein the Traffic Me 
comprises an Aggregate Traffic Metric characterized by: 

ra(i,t)=£T,(f,,t) 

where 

TA(i f t) is an Aggregate Traffic Metric for selected 
link i , and 

T^f^t) is the Traffic Metric of Flow f x in link i, 
sampled at time t. 
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23. The method of Claim 22, wherein the Traffic 
Metric comprises a Scaled Aggregate Traffic Metric 
characterized by: 

STA(i,t)=TA(i,t)*S(i,t) 

where 

STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link i ; 

TA(i,t) is the Traffic Metric observed at time t for 
network link i; and 

S(i,t) is a preselected scaling factor for network 

link i at time t . 

24. The method of Claim 23, wherein the Traffic Metric 
comprises a Link Group Arithmetic Mean characterized by: 

n 

I STA(i,t) 

where 

M(t) is the Link Group Arithmetic Mean of Scaled 
Aggregated Traffic Metrics summed over all network links 
i ; 

STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link i; and 

n is the number of active network links. 

25. The method of Claim 24, wherein the Traffic Metric 
comprises a Link Group Absolute Deviation characterized by: 
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X|5Ti4(/,0- M(0| 



D(t) 



!=1 



n 



where 

Dft; is the Link Group Absolute Deviation of the 
Scaled Aggregated Traffic Metrics summed over all network 
links i; 

STA(i,t) is the Scaled Aggregated Traffic Metric 
observed at time t for network link i; 

M(t) is the Link Group Arithmetic Mean of the Scaled 
Aggregated Traffic Metrics summed over all network links 
i ; and 

n is the number of active network links. 

26. The method of Claim 25, wherein: 

a. a HIGH traffic load on link i is characterized by 

STA(i,t)> M(t)+D(t); 

b. a LOW traffic load on link i is characterized by 

STA(i,t)< M(t)-D(t); and 

c. a NORMAL traffic load on link i is characterized by 

M{t) + D(t) > STA(i,t) > M{t) - D(t) . 

27. The method of Claim 26, wherein the regrouping comprises 
moving a preselected flow from a first flow list corresponding to 
a first preselected link having a HIGH traffic load to a second 
flow list corresponding to a second preselected link having one of 
a NORMAL traffic load and a LOW traffic load. 
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28. The method of Claim 21, wherein the predetermined link 
load factor, K ixf for Flow x in link i is between about 1.0 and 
about 10.0, 

5 29. The method of Claim 28, wherein the predetermined link 

load factor, K ixf for Flow x in link i is between about 4.0 and 
about 5.0. 

30. A method for balancing transmission unit traffic over 
10 heterogeneous speed network links, comprising: 

a. disposing transmission units into flows, wherein each of 
the transmission units includes one of source information, 
destination information, and a combination thereof, and the 
disposing comprises characterizing each of the transmission units 

15 according to one of the source information, the destination 
information, and a combination thereof, and wherein each of the 
transmission units comprise one of a packet, a frame, a cell, and 
a combination thereof; 

b. grouping flows into first flow lists, each of the first 
20 decreasing-size-ordered linked flow lists corresponding to a 

selected network link; 

c. determining a traffic metric representative of a traffic 
load on the selected network link; 

d. responsive to the traffic metric, regrouping flows into 
25 second decreasing-size-ordered linked flow lists corresponding to 

the selected network link, the regrouping balancing the 
transmission unit traffic among the network links; and 

e. transmitting the respective second flow list over the 
respective selected network link using a predetermined link-layer 

30 transmission protocol, wherein the predetermined link-layer 
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transmission protocol communicates the transmission unit traffic 
over the network links in cooperation with a network-layer 
protocol; wherein the network-layer protocol cooperates with a 
transport -layer protocol to communicate the transmission unit 
5 traffic across the network links, and wherein each of the network- 
layer protocol and the transport -layer protocol is one of a 
connectionless protocol and a connection-based protocol. 

31. The method of Claim 30, wherein the predetermined link- 
10 layer transmission protocol is one of an IEEE STD. 802 protocol, an 
ATM protocol, an FDD I protocol, an X.2 5 protocol, an ISDN protocol, 
a CDPD protocol, and a Frame Relay protocol; wherein the network- 
layer protocol is one of an internet protocol (IP) , a Switched 
Multi -megabit Data Service protocol (SMDS) , a general packet radio 
15 service (GPRS) , a Message Transfer Part Level 3 protocol (MTP3 ) , a 
an internet packet exchange protocol (IPX), an X.25/X.75 protocol, 
a connectionless network protocol (CLNP) , internet datagram 
protocol (IDP) , a datagram delivery protocol (DDP) , a Xerox Network 
Systems protocol (XNS) , and a combination thereof; and wherein the 
2 0 transport -layer protocol is one of a transmission control protocol 
(TCP) , a user datagram protocol (UDP) , a NetBIOS protocol, an H.323 
protocol, a GSM/CDMA protocol, a Stream Control Transmission 
Protocol (SCTP) , and a combination thereof. 

25 32. The method of Claim 30, wherein the predetermined link- 

layer transmission protocol is an IEEE STD. 8 02.3 protocol, wherein 
the network-layer protocol is an internet protocol (IP) , and 
wherein the transport-layer protocol is a transmission control 
protocol (TCP) . 

30 
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33. The method of Claim 32, wherein the Traffic Metric 
representative of a traffic load on the selected network link 
comprises a Link Group Arithmetic Mean and the determining the 
Traffic Metric comprises: 

determining a Link Traffic Flow Metric characterized by 



a . 



TXU) = z — 



where 

T-Xf x j) is a Traffic Metric of Flow f x in selected 

link i, sampled at time t, 

N 'tXfx'O is the number of transmission units of Flow 
f x in selected link i, with a transmission unit size 
greater than or equal to a preselected size threshold, 
observed between time t - 2 and time t, 

N Sl (f x J) is the number of transmission units of 

Flow f x in selected link i, with a transmission unit size 
less than a preselected size threshold, observed between 
sampling time t - 2 and time t, 

K ix is a predetermined link load factor for Flow 
x in link i having a value in a range between about 4.0 
and about 5.0, and 

A^is the inter-sampling time, measured as the 
interval between time t - 1 and time t, in selected link 
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b. determining an Aggregate Traffic Metric characterized by 

L4(/,/)=I W,.0 

x 

where 

TA(i,t) is an Aggregate Traffic Metric for selected 
link i, and 

T t (f x ,t) is the Traffic Metric of Flow f x in link i, 
sampled at time t; 

c. determining a Scaled Aggregate Traffic Metric 
characterized by 

STA(i 9 t)= TA(i 9 t)*S{i,t) 

where 

STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link i, 

TA(i,t) is the Traffic Metric observed at time t for 
network link i, and 

S(i,t) is a preselected scaling factor for network 

link i at time t ; and 

d. determining a Link Group Arithmetic Mean characterized by 

n 

£ STA(i,t) 

where 

M(t) is the Link Group Arithmetic Mean of Scaled 
Aggregated Traffic Metrics summed over all network links 
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STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link i, and 

n is the number of active network links. 

5 34. The method of Claim 33, further comprising determining a 

Link Group Absolute Deviation characterized by 



ft 

Y\STA(i,t)- M(t)\ 



; = 1 



n 



where 

D(t) is the Link Group Absolute Deviation of the 
10 Scaled Aggregated Traffic Metrics summed over all network 

links i, 

STA(i,t) is the Scaled Aggregated Traffic Metric 
observed at time t for network link i, 

M(t) is the Link Group Arithmetic Mean of the Scaled 
15 Aggregated Traffic Metrics summed over all network links 

i , and 

12 is the number of active network links; and 
b. wherein 

(1) a HIGH traffic load on link 1 is 

2 0 characterized by STA(i,t) > M{t) + D(t) , 

(2) a LOW traffic load on link i is 
characterized by STA(j,t)< M(t)~ D(t) , and 

(3) a NORMAL traffic load on link i is 
characterized by M(t) + D(t) > STA(i 9 t) > M(t) - D(t) . 



-37- 



40694/JFO/B600-BP 1565 



35. The method of Claim 34, wherein the regrouping comprises 
moving a preselected flow from a first flow list corresponding to 
a first preselected link having a HIGH traffic load to a second 
flow list corresponding to a second preselected link having one of 

5 a NORMAL traffic load and a LOW traffic load. 

36. A method for transmitting transmission units through a 

network, comprising: 

a. receiving a transmission unit from a transmission 

10 unit source ; 

b. classifying the transmission unit according to a 

predetermined flow characteristic; 

c. selecting a preselected network link over which the 
transmission unit is to be transmitted; and 

15 d. transmitting the transmission unit over the 

preselected network link. 

37. The method of Claim 36, further comprising selecting the 
preselected network link according to the predetermined flow 

20 characteristic using a predetermined dynamic load balancing 
technique . 

38. The method of Claim 37, further comprising monitoring the 
operation of a plurality of preselected network links, and re- 

25 assigning the predetermined flow characteristic from a first 
preselected network link to a second preselected network link, if 
the first preselected network link operationally fails. 
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39. A computer program product recorded on a computer 
readable medium for balancing transmission unit traffic over 
network links, comprising: 

a. computer readable program code which disposes 

transmission units into flows; 

b. computer readable program code which groups flows into 
first flow lists, each of the first flow lists corresponding to a 
selected network link; 

c. computer readable program code which determines a traffic 
metric representative of a traffic load on the selected network 
link; 

d. computer readable program code which, responsive to the 
traffic metric, re-assigns flows into second flow lists 
corresponding to the selected network link, the re-assigning 
balancing the transmission unit traffic among the network links; 
and 

e. computer readable program code which transmits the 
respective second flow list over the respective selected network 
link. 

40. The computer program product of Claim 39, wherein each of 
the transmission units comprises one of a packet, a frame, a cell, 
and a combination thereof. 

41. The computer program product of Claim 39, wherein each of 
the transmission units includes one of source information, 
destination information, and a combination thereof, and the 
disposing comprises characterizing each of the transmission units 
according to one of the source information, the destination 
information, and a combination thereof. 
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42. The computer program product of Claim 39, wherein the 
transmission unit traffic is effected using a predetermined link- 
layer transmission protocol. 

5 43. The computer program product of Claim 42, wherein the 

predetermined link-layer transmission protocol is one of a packet- 
based protocol, a cell-based protocol, a frame-based protocol, and 
a combination thereof. 

10 44. The computer program product of Claim 43, wherein the 

predetermined link-layer transmission protocol is one of an IEEE 
STD . 802 protocol, an ATM protocol, an FDD I protocol, an X.25 
protocol, an ISDN protocol, a CDPD protocol, and a Frame Relay 
protocol . 

15 

45. The computer program product of Claim 42, wherein the 
predetermined link-layer transmission protocol communicates the 
transmission unit traffic over the network links in cooperation 
with a network-layer protocol. 

20 

46. The computer program product of Claim 42, wherein the 
predetermined link- layer transmission protocol communicates the 
transmission unit traffic over the network links in cooperation 
with a transport -layer protocol. 

25 

47. The computer program product of Claim 45, wherein the 
network-layer protocol cooperates with a transport -layer protocol 
to communicate the transmission unit traffic across the network 
links . 

30 
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48. The computer program product of Claim 45, wherein the 
network- layer protocol is one of a connectionless protocol and a 
connection-based protocol. 

5 49. The computer program product of Claim 48, wherein the 

network- layer protocol is a connectionless protocol, and the 
connectionless protocol is an internet protocol (IP) . 

50. The computer program product of Claim 48, wherein the 
10 network- layer protocol is one of an internet protocol (IP) , a 

Switched Multi-megabit Data Service protocol (SMDS) , a general 
packet radio service (GPRS) , a Message Transfer Part Level 3 
protocol (MTP3), a an internet packet exchange protocol (IPX), an 
X.25/X.75 protocol, a connectionless network protocol (CLNP) , 
15 internet datagram protocol (IDP) , a datagram delivery protocol 
(DDP) , a Xerox Network Systems protocol (XNS) , and a combination 
thereof . 

51. The computer program product of Claim 47, wherein the 
20 transport -layer protocol is one of a connectionless protocol and a 

connection-based protocol. 

52. The computer program product of Claim 51, wherein the 
transport -layer protocol is a connection-based protocol, and the 

25 connection-based protocol is a transmission control protocol (TCP) . 
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53. The computer program product of Claim 51, wherein the 
transport -layer protocol is one of a transmission control protocol 
(TCP) , a user datagram protocol (UDP) , a NetBIOS protocol, an H.323 
protocol, a GSM/CDMA protocol, a Stream Control Transmission 

5 Protocol (SCTP) , and a combination thereof. 

54. The computer program product of Claim 47, wherein the 
network-layer protocol is a connectionless protocol and the 
connectionless protocol is an internet protocol (IP) , and wherein 

10 the transport -layer protocol is a connection-based protocol, and 
the connection-based protocol is a transmission control protocol 
(TCP) . 

55. The computer program product of Claim 3 9 , wherein the 
15 network links are network links having heterogeneous speed. 

56. The computer program product of Claim 41, wherein the 
first flow lists are ordered flow lists. 

20 57. The computer program product of Claim 56, wherein each of 

the ordered flow list comprises a linked list ordered by flow size. 

58. The computer program product of Claim 57, wherein the 
ordered flow list is ordered by decreasing flow size. 

25 
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20 



59. The computer program product of Claim 39, wherein 
determining a Traffic Metric representative of a traffic load on 
the selected network link comprises: 

N L XL,tyK 1 + N Sl {f x ,t) 



■+T,(f x ,t-1) 



T,(f x ,0= ~ 



5 where 

T i ( < f x ^t) is a Traffic Metric of Flow f x in selected 

link i, sampled at time t; 

N Ll (f x J) is the number of transmission units of Flow 

f x in selected link i , with a transmission unit size 
10 greater than or equal to a preselected size threshold, 

observed between time t - 1 and time t; 

N Sl {f x j) is the number of transmission units of 

Flow f x in selected link i, with a transmission unit size 
less than a preselected size threshold, observed between 
15 sampling time t - 1 and time t; 

K ix is a predetermined link load factor; and 

At is the inter-sampling time, measured as the 
interval between time t - 1 and time t, in selected link 

2 . 



60. The computer program product of Claim 59, wherein the 
Traffic Metric comprises an Aggregate Traffic Metric characterized 

by: TA(i,t)=l J T l (f x ,t) 
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where 

TA(i,t) is an Aggregate Traffic Metric for selected 
link i, and 

TXf x j) is the Traffic Metric of Flow f x in link i, 
sampled at time t. 

61. The computer program product of Claim 60, wherein 
the Traffic Metric comprises a Scaled Aggregate Traffic Metric 
characterized by: 

STA(i,t)= TA(i,t)*S(i 9 t) 

where 

STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link i; 

TA(i,t) is the Traffic Metric observed at time t for 
network link 1; and 

S(i,t) is a preselected scaling factor for network 

link i at time t. 

62. The computer program product of Claim 61, wherein the 
Traffic Metric comprises a Link Group Arithmetic Mean characterized 
by: 

n 

I STA(i,t) 



where 
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M(t) is the Link Group Arithmetic Mean of Scaled 
Aggregated Traffic Metrics summed over all network links 
i ; 

STA(i,t) is the Scaled Aggregated Traffic Metrics 
observed at time t for network link 1; and 

n is the number of active network links. 

63. The computer program product of Claim 62, wherein the 
Traffic Metric comprises a Link Group Absolute Deviation 
characterized by: 

n 

YASTA{i,t)- M(ti 

D(t) = ^ 

n 

where 

D(t) is the Link Group Absolute Deviation of the 
Scaled Aggregated Traffic Metrics summed over all network 
links i; 

STA(i,t) is the Scaled Aggregated Traffic Metric 
observed at time t for network link i; 

M(t) is the Link Group Arithmetic Mean of the Scaled 
Aggregated Traffic Metrics summed over all network links 
i ; and 

i3 is the number of active network links. 



64. The computer program product of Claim 63, wherein: 
a. a HIGH traffic load on link i is characterized by 
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STA(i,t)> M(t)+D(t); 

b. a LOW traffic load on link i is characterized by 

STA(i,t) < M(t)- D{t) ; and 

c. a NORMAL traffic load on link i is characterized by 

M(t) + D(t) > STA(i,t) > M{t) - D{t) . 

65. The computer program product of Claim 64, wherein the 
regrouping comprises moving a preselected flow from a first flow 
list corresponding to a first preselected link having a HIGH 
traffic load to a second flow list corresponding to a second 
preselected link having one of a NORMAL traffic load and a LOW 
traffic load. 

66. The computer program product of Claim 59, wherein the 
predetermined link load factor, K ix , for Flow x in link i is between 
about 1.0 and about 10.0. 

67. The computer program product of Claim 66, wherein the 
predetermined link load factor, K ixl for Flow x in link i is between 
about 4 . 0 and about 5.0. 

68. A network load balancer in a communication network having 
network links, comprising: 

a. a flow synthesizer that receives transmission units from 
a transmission unit source, and synthesizes flows characteristic of 
selected transmission units; and 

b. a link classifier, coupled with the flow synthesizer and 
the network links, that classifies the network links relative to a 
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predetermined flow metric, and assigns selected flows to selected 
network links responsive to the predetermined flow metric, the 
selected transmission units corresponding to the selected flows 
being communicated with the communication network through the 
5 respective selected network links. 

69. The network load balancer of Claim 68, further comprising 
a flow classifier, coupled with the link classifier, that 
determines flow characteristics representative of a plurality of 

10 selected flows, and responsive thereto, assigns the plurality of 
selected flows to a selected link such that the selected 
transmission units respectively represented by the plurality of 
selected flows are communicated with the communication network 
through the respective selected network links. 

15 

70. The network load balancer of Claim 69, further comprising 
a link failure detector that causes the link classifier to re- 
assign the selected flows to others of the selected links in 
response to a network link failure. 
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